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FOREWORD T 

The purpose of this handbook is to asstet State, District, and School persopnel in 
implementing the Assessment Component of the Founbation Program Asse^snrfent and 
Ir^provement System (FRAIS). 

The Foundation Program Assessment and Improvement System Is the^epartment of 
Education's comprehensive system for managing curriculum. It \s based on the Foundation 
Program, whici) assists schools in carrying out the commitments of public education in 
Hawaii. 

The primary intent of the Foundation Program Assessment and Improvement System is to 
improve instruction for students through systematic improvements in the Foundation 
Progki^oi. Assessments are inlprtemented, coordinated and related to curricJium 
^hnprovements by this curriculum management system. 

* The handbook is the result of a Department-wide effort. Many individuals from the State, 
District, School, Universrty Hawaii, professional and community sectors contributed 
substantial time and energies to its development. 

The further refinement of this publication will proceed as an ongoing effort. Suggestions 
for improving it are welcomed. 



Charles Q. Clark 
Superintendent . 
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1. INTRODUCTION 

As described in the base document, Ttw Foundation Program Assessment and 
Improvement System (FPAJS), the system consists of an Assessment Component and an 
Improvement Component. ThaAssessment Component employs a range of testing and non- 
testing procedures, with emphasis on curriculum review and analysis. 

The *flow of activities and relationship between the Assessment Component and 
Improvement Component is^ depicted in tije figure below. 
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Figure 1. Relatioriship Between the Assessment 
^ and Improvement Components 
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' The. Foundation Program' Assessment and Improvement System defines assessment 
broadly as the gathering and analysis of information for evaluative purposes. Through 
assessment, neekJs are deternlned and retated to planning for curriculum improvement. 

Within the Hawaii StateOepartment of Education, assessments are Conducted for a variety 
of purposes. These include detei'mining the extent of student attainment of specified 
objectives, x;ertifying mastery of competencies, reviewing the curriculum to determine 
whether intended learning is occurring, reviewing instructional materials and^approaches, 
and determining. student readiness. 

This handbook specifies procedures appropriate for carrying out asjsessmenfs in the 
Department. In education, as jn every other field of^work, the quality of decisions made is 
dependent upon adequate data. For this reason, the strengthening of asse^ment efforts is a 
vitahcync^rn at every level of the Department. 




2. THE ASSESSMENT STRATEGY 



Education in a dynamic' society is similarly dynamib. Changing social currents, new 
populations, new economic and career opportunities, and the increasing aspirations of 
parents for their children guarantee that education must and wilj change. 

Changes in education derive from many sources. Some changes cannot be predicted, 
since they come from governmental, legal, political, and educational events which cartnot be 
*known*in advance. Other changes in education can be identitied by professional monitoring 
of the educational scene, working with sucti constituencies as labor, business, government, 
higher education, and other cOlnmunity -nrqups. Regardless of the source of change, 
tiowever, a thorough analysis of the issueslptoblems, difficulties, or visions of a preferred 
future i3essen'ti'al. When the assessment process is completed, the improvernent process—the 
"I" pf FBWkJS— can proceed. ^ 

The^ssessment strategy con^i^ts of those proceokjres specified in the assessment 
'component for gathering information and measuring jachievemeht of objectives' and 
competencies for the puH^ose of assessing needs for program improvement. 

Two types of assessment are represented in this strategy (see Figure 2). The first pertains 
to the initial identification of possible needSi and is represented by two methods. The first 
method, and the preTerred one, is continual monitoring and review by an individual or 
organized work group (Type 1A). The second is the initial identification of need for 
improvement by administrative decision, (Type IB). Following this, when need for. further 
assessment is indicated. Type 2 assessment is recommended, in which a more thorough 
^nquiry is made. 



Figure 2. The Assessment Strategy 
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Typ« 1A Assessment 

Type 1A Assessment activities are those which are continuing in nature, either periodic or 
cyclical Commonly called "monitoring" or "review," they are initig^ted on the assum^jption that 
educational programs are often in need of improvement. It is also assumed that data are 
readily available and can be organize^ and analyzed with a modest effort and that issues 
judged important will be studied in greater depth in Type 2 Assessment. 

\. Example of Type 1A Assessment activities include the following: 

a. Study of basic data: (1) achievement test data, enrollment in subjects and courses. ' 
grjades given iri various courses, ancf other evidence of student success or failure; 
(2) data on organizational climate^ (3) staff data; (4) community data. 

b. Folld^-up studies of graduates. 

c. School self-studies^ "(including School Accreditation). 

d. Cursory review of contemporary trends, issues, criticisms, and reports of simple 
analysis. 

e. A review of treatment of thematic and special purpose, are^s of the Foundati^ 
Program ir^ appropriate subject areas. ^. 

The type 1 A Assessment will result in one of three recommendations: ' ^ 

a. The area assessed requires no change. * * * 

b. The area assessed requires minor changes of direction, ^emphasis, or resources. 
^ c. The area assessed requires a systematic and thoroug>i Type 2 Assessment. 

Recommendations are made to the Assistant Superintendent, District Superintendent, or 
^Principal, Whichever is appropriate. After consultation with advisory bodies such as tl^e FPAIS 
Review and Dissemination Committeera ^ecision is made on the appropriate action to take. 

Type IB Assessment (Admini^rative Decision) 

There are occasions when an administratorrecommends the immediate commencement 
of Type 2 Assessment without going through Type 1A ^^rocedures. This happens when 
^3ufficient evidence indicates that a problem exists. For example, a new law is passed; ^ 
legl^kU^ state or federal* program becomes available; a court or, administrative decisiprr 
requiresa^'tJefiM response. * ^ 

« 

Type 2 Assessment 

Type 2 Assessments are systematic, sharply focussed, and formal. They inclucTe fjgorous 
consideration and testing of hypotheses^which attempt to explain the difficulties. They offer 
possible alternative explanations and provide a thorough analysis which gives guidance on 
the nature of the improvement-effort required. Exafhples of activities which might require 
Type 2 Assessment include: 



a. Conducting research jnto condijtions at the school, district state or national levels, 
including comparative conditions and results between schools, between (]istricts,'and 
between local and nationai school systems. 

Analyzing available research, theory, and other documented information.. 



b. 

c. 



Designing and administering special test and non-test instruments and.a^^lyzing the 
data. 



d. Soliciting a range of views and opinions. , ' 

e. .Analyzing present and available progr^am improvement'approaches. 

f. Others. ^ » • . ' 

Type 2 Assessment normally generates the recommendation to use the assessment results 
as a basis for activatirig the improvement cycle. However, there will be occasions when an 
alternative recommendation may be more appropriate, such as deferring §ction until a later 
elate becausie of other pressing events; intensifying existing efforts; or combining action on 
several problematic situations into one improvement effort. 
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ORGAVllZINGr FOR. AN ASSESSMENT 



3; ' 

There are numerous ways of orgarrizing for an assessmem. These mj\ differ from 
situation to situation and will be dependent on local conditions. 

Ttie improvement handbook suggests procedures and a structure,©! work groups for 
identifying improvement strategies. Because the assessment and improvement cycle? make 
up a larger, continuous cycle, in many case^t jri^y be desirable to use the same committee or 
work group to plan both assessment and iti|foVementJhis committee should include in its 
compqpition individuals v^o are Kpowledgeabfe 'about assessment. As planning progresses 
and needs afe determined; additrohal staff may be added as appropriate. ."^ 

The following structure of decision-making^review, advisory work-groups is suggested. 



Figura 3. ' Organizational Structure iof the Foundation Program 
^ Assessment and Improvement System 
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SMENT CYCLE CHECKLIST 



^ment Cycle Che^list which follows has been developed as a generafg'uidefor 
Type 2 Assessment of educational programs and services. The cfiecklistmay be used before^ 
or during an assessment as a means of assuring that all major steps are considered. For, Type 1 
Assessments, use^of the checklist requires selective modifications or adjustments according 
to. need/ , * * - ' ^ . . . - 

The checklist is b^ed on the nine steps of the Assessment Ccfmponent of the Foundation 
Program Assessmer^and Improvement System (gee Figure 4), There are two lines of logic. 
The first (indicated by the heav^y line) is linear an(J sequential. The second (mdicated by the 
•dotted line) nonsequential, allowing selective consideration and ordering of assessment 
activities. - 

The conduct of the assessment is assigned to a work group which is immediately 
responsible to a d€tcision-maker. 

Figure 4. Assessment Ste^s ^ 
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Step 1: D«tortnine Assessment Needs 

There must be a peed or purpose to undertake an assessment. The ultimate test Qf the 
usefulness of an assessment rests on whether or not educational decision-makers 
(legislators. State Superintendent^, principals, teachens and others) do study asses^nent 
results and make some decisions or take actions that are related to insights gained from the 
information gathered. Thus, to ^ve the assessment effort credibility, the manager must set 
goals for the assessment, develop a rationale for initiating the assessment. > identify th? 
specific. objectives against which the programs or service is to be ass^sed. and identify 
program information requirements necessary for decision-making. ^ ^ 

■' a o 

Qiiestions " . / z< 

1. What is the reason or purpose for the assessment? / y° 

2. What questions are being asked? ^ ° ° 

3. What groups will make decisions and what kinds of decisions will be made as a do 
result of the assessment? . * - 

4. What informWon is needed by the decisibrj-maKers? " ' °° 

a. What educational element(s) is/are to be assessed: Jearner. teacher, program. •□ □ 
organization. fae4lities. services? 

b. . What are the state^ purposes, objectives, functions of the element(s) being □ □ 

assessed? 



c. What standard is to be used tn making the asi ijjj^iieht of the elements? □ □ 

d. How adequate are the state purposes, objectives,, functions of ttie elements □ 
in relation to thfe Startdard? 

5. What information is already available? Has similar information been gathered 
before and by whom? ^ 

Step 2: Determine Assessment Parameters 

, k reali^ic assessment activity is manageable in scope. It can be successfully implemented 
wttWh the constraints of Established priorities, available resources, and available time. In 
order to determine the scope of an assessment, it is necessary to consider the specific areas to 
be assessed; target groups; resources available; and the time heeded to conduct the 
assessment. " — 



CL c a 

Questions ^ . < z< 

*1. What testing information should be collected? ° ° 

2. ^ What non-testing information shoultTbe collected? . □ □ 

3. ' What target group(s) should be considered in the assessment? d □ 

4. What resources are available (including money, personnel, facilities, time)? □ □ 

5. What is the timeline of the activities? ° ° 

6. Are events coordinated? . ° ° 

^ ■ ' 15 
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What are the special requirements of other persons or agencies involved in the □ □ 
assesshient? 

8. Have the needs of multi-purpose assessment been clearly analyzed? □ □ 

a. Are all informational needs of the same priority? □ □ 

b. !^re the infQrm^ational needs compatible? □ □ 

Step 3: Obtain Data Collection* Instruments ^ 

Assessment data can be collected in many different ways. In choosing a technique, Vowf—^ 
factors should Be considered. First, the method should be agreeable to critical groups 
involved. Second, the information collection techniques should be technically sound and the 
data collected ffom them should be reliable, valid, and targeted to the objectives" of the 
assessment. Third, the information collection techniques should provide the best data the^ 
assessment budget can afford; which means deciding such things as whether to buy or 
develop instrumfents of whethei*Nio use more than ^ne technique for ea6h assessment 
objective. Fourth, the methbds should allow enough time for gathering and analyzing the 
data. \ ' 5 « 



S 3 



Questions, - ^ ' ' ^ <!<§' 

1. .What standardized test? exist to carry out the assessment of each objective? a □ 

2. ^ What speciaHnstruments are needed? ' * □ □ 

3. Have appropriate instruments to measure each objective been identified? □ P 

4. Had adequate tirhe been allocated to deyefop, field-test and revise specially □ □ 
produced iwtrumehts?* 

< 

5. What4echniques are to-be used which are: * o o 

a. appropriate to the target population? * ^ \ □ □„ 

b. . acpeptable to the various levels in the decision chain (school, district, ^a^^^ □ □ 



Step 4: Determine Data: Collection Procedures 

Determining data coHection procedures consists of establishing plans and procedures for 
obtaining data from testing/non-teisting activities. It also includes procedures for scoring, 
editing, and training personneHnvolved in the data collection activities. 

Questions . ^ i <2< 

1. What is the plan for gathering existing data?. . . ° ° 

□ □ 

□ □ 



^ • 

5 I 

Q. ig 



2. VVhat is the plan for gathering new data? 

a. What sampling plarfis to be used, including sampling techniques appropriate 
to the assessment?" 

b. Whafprocedures n^ust be carried out in the administration of data collection 9 
activities? 

. 9 . 
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, 1)' Who will carry out the data collection? ^ . □ □ 

^ 2) Has sufficient time been allocated for data collection activities? " D □ 

3) Has special inservice training needsof staff for data collection been met? □ □ 

4) Has scheduling been done and communicated to all parties affected? □ □ 
Whafl scoring procedures are to be used (machine, manual, other)? □ 



StepS:. Determine Reporting Requiremeote 

Determining reporting requirements refers to identifying thfe recipients of the assessment 
report, the specific information required^ and the strategies and media format to be u^d. ^ 

5.1 

a g c 

Questions » ' ^ 5-24 

^TT^ What will be (he content of the report(s)? / □ ° 

2. Who.will receive the assessment report(s)? □□ 

3. What will be the format of the report(s) for the various audiences (full report, □ □ 
summary, oral, other)? 

< 

>,4. ^ What are the reporting dates? ° ^ 



Step 6: Determine Dati Analysis Procedures 

Data analysis is the process of organizing raw data to .obtain useful information. 
Techniques for analyzing data may range from simple fank ordering of scores to very 
complex statistical treatments. Prior tO'-conducting an assessment, an analytic ^ 
methodology or set of procdbureS for analyzing and interpreting the data collected / 
should be established. These procedures should be appropriate to the purpose of data | 
CQllection and kinds of data collected.* ^ ' ^ | 

Q^^^ons , / , / 1 1 

/I. What are the procedurers for data artalysis^ * ° d 

a. What ar^ the objectives of the assessment identified in Step 1? ^ □ □ 

b. What are the information needed by decision-makers* identified in Step 1? □ □ 

c. How will the data be arrayed? 

1) to show the relationship of assessment information to the objectives? □ □ 

2) to facilitate analysis? * □ 

3) to present the data validly, Tdpncisely, and clearly? - ^ □ □ 

d. * How wllLthe data be treated? □ □ 
2. How will the procedi^res for^ata analysis be implemented? □ □ 

a. Who will 6i^^^ ana^ysis? D □ 

10 ^ 
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b. What technical assistance or consultation service ^s needed, available, and □ □ 
will be used? 



c. What is the timeline for data analysis? ^ □ □ 

* V • * 

Snqr 7: 'Determine Data Sysnthesis and Presentation Procedures 

Determining data synthesis'and presentation procedures includes deciding off the 
contehl of the assessment report, the data comparisons, and the display format,^ch as 
graphs and tables, appropriate for reporting on the data collected. 

b^^stions 4 III 

1. What data synthesis and presentation procedures will be used? □ □ 

a. What comparisons will Ije made? ' □□ 

b. ^ What data displays win be used? * . □ □ 

2. What form will the presentation take to most clearly answer the qu^dtions asked fi' o. 



by decision-makers? 



JStep 9: * Collect the Data 

\ This step consists of carrying out the plans arrived at in Step 3 ar^d Step 4. 



Step 9: Analyze the Data 

^ This step consists of carrying out the reporting, data analysis, data synthesis ^nd '| 
presentation procedures iderti(ied in Step 5. Step 6 and Step 7. ^ • I 



9- 
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Questions . - 

1. Has the data analysis plan been carried out? ^ ^ □ □ 

2. Have the data synthesis and presentation procedures been carried out? □ Q 

3. Have all reporting requirements been carried out? □ □ 



I 



5. ASSESSMENT RESPONSIBILITIES . ) 

The charts which follow identify the responsibilities of the state, districtand school during 
an assessment. These responsibilities have been determined from t^e perspective of the 
source of initiative for the^assessment (state, district, or school). Because the responsibilities 
of each level change both qualitatively and quantitively according to whichever tevel initfates ' 
( the assessment, separate charts are provided. It should be noted, however, thatjregardless,of 
the initiative for the assessment, the involvement of the various levels is essential. 

These charts are (i^ganized according to major work phases for each $tep of the 
V Assessment Component, and responsibilities have been^eyed to these work phases. It is 
recognized that in particular cases some<?f the work phases may not require that full attention 
be given to them, or may be omitted. wH^n this occurs, ? corresponding modification or 
deletion of Jthe responsibilities is appropriate. 
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ASSESSMENT RESPONSIBILITY CHART: STATE-INITIATED ASSESSMENT 









'OutiM and R«H>onsiMlltlM 




ASMMUMlrt Ottpi 


Wofk Phfliii 


STATE 


District 


School 


4 


1. DETERMINATION OF 
NEED FOR • 
ASSESSMENT 


Development of ^ 
rationale for the 
assessment. 


Assume responsibility 

3nr HAUAlnnmAnt nf 

rationale. 


r 

Provide district input 

ctrivJ GiSKiisiciiiwo as a\j\JT\j^ 

priate. 






« 


Determination of 

objeetives and 

decision requirements. ^ 


Obtain input or consult 

and other appropriate 
individuals or groups. 


Provide'schoof input 
flnH assistAnce as 
appropriate. 




2. DETERMINATION OF 
ASSESSMENT 
PARAMETERS 


Idmtification of 
are»s^o be assessed^ 


Assume responsibility 
for determining assess- 
ment parameters. 








• 

• 


Determination of ^ 
larget groups. 

Identification of x 
available resources in 

objectives. 


, Obtain input or consult 
wjth district, school 
and other appropriate 
individuals or groups. 

1 


Provide district input 
and assistance as * 
appropriate. ^ ^ 


Provide school input 
and assistance as 
appropriate. 

• 




* 


Estabtlishment of 
9ssessment timeline. 


• 




i 

* 


3. Obtaining data 
collection 

✓ 

• - 


Determination of 
assessment instruments 
nveaeu. 

Examinatioh of 
availajDie assessment 
instruments. ^ 


oarry oui review ana 
selection process. 


s^nd assistance as 
atoropriate. 

^■<^-, 


Provide school Inout 
and assistance^ as 
appropriate. 

t 

0 




'i 

» 


Development of appro- 
priate assessment 
instruments. 
' / * * 


Make necessary ar- 
rangements for develop- 
ment process. Arrange 
for district and state 
assistance as r^d^. 

« 


Provide district input 
and assjstance and 
arrange for school 
Involvement as needed in 
test development 

feting, revii^w of 
manuals and guidelines. 


Provide school input 
and assistance as 
appropriate. 

Participate as testing 

sit A AS nAAdAd 
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Establishment. of 
assessment timelfne. 


• 


-1 


/ 21 . 
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AMMMMnt Stop* 



Wofk PhMM 



4. DETERMI^4ATI0N OF 
DATA COLLECTION 
PROCEDURES , 



5. DETERMINifl}TION OF 
REPORTING 
REQUIREMENTS 



DETERMINATION OF 
DATA ANALYSIS 
PROCEPURES 



Development of 

data collection 

plan for existiog data. 

Development of 
plan fOr gathering 
new data: 

, • Sampling pl^n and 
techniques to be 
used. 

• Data collection 
administration 
proc^ures/ 

jDeterminktion of 
scoring procedures. 

[Tevelopitient of pmt\ 
for data prpcessirlg. 

Determiriiitioa of 
cofi^nt of assessment 
report(s)' 

Determination of who . 
is to receive assessment 
report(s). ^ 

Determination of 
how the information 
will be report^<r\ 
(strategics and format). 

Establishment of » 
reporting timelin^. 

Development of 
data analysis «^ 
plan. « 

Determination of, * 
how data analysis 
plan will be imple- 
mented. 



Duties and Retpontlblllttei 



STATE 



District 



School 



Atsurrfc responsibility 
for development of 
plans. / . 

Obtain input or consult 
with district, school 
and other appropriate 
individuals or groups. 



Provide district input 
and assistancQlas 
appropriate. # 



Provide ischodi input 
and assistance as 
appropriate. 



J 



Assume responsibility 
for determining reporting 
requirements. 



V ' 

Provide.district input 
and, assistance as 
appropriate. ' 



Provide school mput 
and assistance as 
appropriate. 



y^ssumj^ responsibility 
for development of 
data ahalysis plan. 

Obtain input or consult 
with district, school 
and other Appropriate 
individuals or groups. 

1 



Provide district input 
and assistance as 
appropriate 



2 



Provide school input 
and assistance as 
appropriate. 



V 



V 



AssMsmtnt Stept^ 


Work PhapM 


f Duties and Responsibilities 


STATE 


District 


School 


7 DETERMINATION 
OF DATA SYNTHESIS 
AND PRESENTATION 
^OCEOURES 

* 


r^pfprmi nation nf 

how the information 
will be put together 
(synthesized) and 
presented (displayed 
ana reponeo;. 


Assume responsibility 
for determining data 
synthesis and presenta- 
tion procedures. 

\ 


^ " 

Provide district input 
ancJ assistance as 
appropriate. 


Provide schooJ Input 
and assistance as 
appropriate. 


■ t 


• 


Obtain input or consult 
with district, school 

anH nthpr sinnrnnfifltp 

individuals or groups. 


• 


\ 


8. COLLEQTrON OF 
DATA 

f 


. Implenneritation of ' 
procedures and 
schedule for data 
collection. 


' Assume responsibility 
lur sidiowiuo ieaQer~ 
ship and coordination 
of data collection 
effort. , 




• 






\A/nrk with ahH thrniinh 
vv^./ifv Willi ciriu iMiUuyii 

district in obtaining 
school involvement. , 


Mrrany© TOr SCHOOI 

involvement in data 
collection effort. 


Become involved in 
data collection effort. 

* 


9. ANALYSIS OF DATA , 

• 


Implementation ot^ 
crata analysis and 
interpre^on 
procjedOres. 


Compile, analyze^and 
- interpret data. 

\ 




• 


» 


lmplementatior> of 
. assessment reporting 
plan. 4 

f * 


1 Obtain input or consult 
with district, school 
and other appropriate 
individuals or groups. 

Distribute assessment " 
report(s) to Intended 
audiences. 


Provide district input 
and assistance as 
appropriate. 

» 


Provide school input 
and assistance as 
appropriate. 

% 
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ASSESSMENT RE^PONSmiLITY CHART: DISTRICT-INITIATED ASSESSMENT 



AsMMiiMnrStops- 



Work PhasM 



DutlM an,d R^pontlMlitiM 



DISTRICT 



School 



State 



1. DETERMINATION OF 
■ NEED FOR 
ASSESSMENT 



2. DETERMINATION OF 
ASSESSMENT-. 
PARAMETERS 



3. OBTAININGTDATA 
COLLECTION 
INSTRUMENTS 
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Dev^lopment of ration- 
ale for the assessment. 



Determination of 
ctbjectives and decision 
requirements. 



Identification of 
areas to be assessed. 



Determination of tai^et 
groups. 

Identification of ^ 
available resources 
in relation to assess- 
ment objectives,-* 

Establishment of assess- 
ment timeline. 



etermination of ' 
assessment instruments 
e0ded^. 

Examination of available 
assessyient instruments. 

DevelOQii^nt of appro- 
priate fisessm'ent 

instruments. 



Establishment of develop- 
meintal timelipi^o > ' 



Assume responsibility 
for development of 
rationale. 

r 

Obtain input or consult 
with state, school and 
other appropriate indi- 
vidual$or groups. 



Assume respdnsibility 
for determining assess-^ 
ment parameters. 

Obtain input i2r consult 
with state, sch90l and 
other appropriate indi- 
viduals or groups. 



r 



Assume responsibility 
for carrying out review 
and selection process. 



Make necessary arrange- 
ments for development 
process. If work is to 
be contracted out, make 
contractuaMKfangements. 



.9 



Provide school input 
and assistance as 
''appropriate. 



5^ 



Provide school input 
and assistance as 
appropriate. 



Provide school input 
and assistance as 
approgrijBite. 



^ Provide school hput 
and assistance as 
appropriate. 



Participate as testing 
site as needed. 



Provide state input and 
assistance as requested 
by district. 



Provide state input and 
assistance as requested 
by district. 



Provide state input and 
assistance as requested 
by district. 



Provide state input and 
assistance as requested 
by district. 



N 



AssMsniMt Stops 



4. DETERMINATION OF 
DATA COLLECTION 
PROCEDURES 



5. DETERMINATION OF 
REPORTING 
REQUIREMENTS. 



6. DETERMINATION OF 
DATA ANALYSIS 
PROCEDURES 

28 



Wofk PhasM 



Development of data 
collection plan for 
existing data. 

Development of plan 
for gatheriifg new data: 

Sampling plan 
and techniques 
" to be used 

• Data collection 
administration 
procedures 

Determination of 
scoring procedures. 

Development of plan for 
data processing. 

Determination of 
content of assessment 
report(s). 

Determination of who 
is to receive asa^ment 
report(s). . 

Determination of how 
- the information will 
be reported (strategies 
and format). 

r 

Estabjishment oti|^ 
, reporting timelinH^ 

bevelopment of data 
analysis plan. 



Determination of hpw 
data analysis plan 
will be Implemented. 



Duties and Responsibilities 


DISTRICT 


Sdiool 


Stats 

-y^ 


Assume responsibility 
for development of 
plans. 






Obtain input or consult 
with state, school and 
other appropriate indi- 
viduals or groups. 


Provide school input 
and assistance as 
appropriate. 


Provide state input and 
assistance as requested 
by district. 


Assume responsibility 
for determining report- 
ing requirements. 


Provide school input 
and assistance as 
appropriate. 


* 

• 

Provide state input and 
assistance as reqjjested 
by district. 








Assume responsibility 
for development of 

(Jala ailaljolo plan. * 

Obtain Input or consult 
with state, school and 
other appropriate indi- 
viduals or groups.. . 


Provide school input 
and assistance as , 
appropriate. 


Provide state input and 
assistance as requested 
by district, 



• > 


' 1 ' * 


Dutliit ami RespontibHIttes 


AmmmmdI Steps 


Wortc PhSMi 


DISTRICT 


School 


^ Stat* 


/ 7. determination of 
data'synthesis ' 
and presentation 
procedures 


Determination of how 
data analysis plan 
will be Implemented. 

Determination of hdw 
thelnformation will be 
presented (displayed) 
and reported). 


Assume responsibility 
\ for determining data 
' synthesis, and pre^en^ 

tation procedures. 

Obtain input or consult 
with state, school and 
^ offier appropriate indi- 
viduals or groups. 


• r 

/ 
f 

Provide school input ^ 
and assistance as 
appropriate. 


Provide state input and 
«assi stance as requested 
by district. - 


• 

8. COLLECTION OF 

- * " ^ . ^ - 


iiT)pieiTieniaXiun ot 
procedures and sche- 
dule for data collection. 


Assume responsibility 
for districtwide leader- 
ship and coordination 
of data collection effort/ 


Provide school input 
and assistance as 
appropriate. 


Provid^'^te input and 
assismnc^ as requested 
by disfnct. 


9. ANALYSIS OF DATA 

♦ 


hnplementation of data 
analysis knd interpreta- 
tion procedures. 

Implementation of « 
assessment reporting 
plan. 


Assume respons^niity 
for coij>^ilirfg, analyzing 
an0 interpr€i||ng\data. 

Obtain hput'or Qonsult 
With state, schoohand 
other appippriate indi- 
viduals or groups. 


Provide school input 
and assistance as 
japprcTpriate. 


Provide state input and 
assistance a%/^equested 
^ by district^ 

• V • 


« 




Distribute assessment 
report(s) to intended 
audiences. 


• 




• * 

3Q 
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ASSESSMENT RESPONSIBILITY CHART: SCHOOL-HNITtATED ASSESSMENT 



AtMtMMnl Slipt 



WOffc PtMMS 



Outlet and RetponflbHItl— 



SCHOOL 



District 



S&lt 



1. DEfErtMINATION OF 
NEED FOR 
ASSESSMENT 



2. DETERMINATION OF 
ASSESSMENT 
PARAMETERS 



3. OBTAINING DATA 
COLLECTION 
INSTRUMENTS 
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Development of 
rationale for the' i 
assesssment.^ « 

Determination of 
objectives and 
decision requirements. 



Identification of 
.areas to be assessed. 



'Determination of 
.target groups. 



Identification of 
available resources 
in^relation to 
assessment 
objectives. 

Establishmery 6f 
assessment timeline. 



Determination of 
assessment^nstru- - 
ments needed.' - * ^ 

Examination ot 
availab^ assessment 
instruments. 

Development of ^ 
appropriate assessment 
instruments. 



Estai>lis|^ment of / 
assessment timeHne. 



Assume responsibility 
for development of 
ratioqale. 

Obtain input or consbit 
with district, state 
and other approprisQe 
individuals or groups. 

Assu/^e responsibility 
for determining 
assessment parameters. 

Obtain inpu^or con^lt 
with district, state 
and other appropriate 
individuals or groups. 



Provide district input 
and assistance as 
requested by school. 



Provide district input 
and assistance as 
requested by school. 



V/ 



Carry out review and 
selection process. , 



Provide district Input 
and assistance as 
requested by school. 



Re necessary a/fange* 
nents for development 
>rocess. Arrangfe for 
}Tsfrict and state 
assistance as needed. 



Provide district ippbt 
and assistance as 
requested by school. 



Provide state input 
and assistance as 
requested by district. 



^ Provide state input 
and assistancepas 
requested by district. 



Provide state input 
and assistance as 
requested by district. 



Provide state input 
and assistance as 
requested by district. 
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Slaps 



PhMM 



4# DETERMINATION OF 
DATA COLLEpTION ' 
PROCEDURES 



5. DETERMINATION OF 
REPORTING 
REQUIREMENTS 



6. D^ERMtNATION OF 
DATA ANALYSIS 
PROCEDURES 
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Development of data 
collection plan for 
existing data. 

Development of plan for 
gathering new data: 

• Sampling plan 
and techniq ues 
to be used. 

• Data collection 
administration 
procedures. 

Determination of 
scoring pro<^ures. 

Development of plan 
for data processing^ 

Determination of content 
of assessmei)t^eport(s). 

Determination of who 
Is to receive 
assessment report(s). 

Determination of how 
the informatfon will 
be reported (strategies 
and format). _^ 

Establishmept o^^ 
reporting timeline. 

Development of data 
analysis plan. 



Determination of how 
data analysis plan will 
be implemented. 



\ 



Duties fid RttponslbHItltt 



SCHOOL 



District 



Stolt 



Assume' responsibility 
for development of 
plans. 

Obtain input or consult' 
with dtstrict, state 
and other appropriate 
individuals or grodps. 



Assume responsibility 
lor^efer mining 
reporting requirements. 



Assume responsibility 
for development of 
analysis pl^n: 

Obtain input or consult 
with district, state 
and other appropriate 
individuals or groups. 



Provide district Input 
apd assistance as 
requested by %chool. 



Provide state Input 
and assistance as 
requested by district. 



Provide district inpu> 
and assistance as 
requested by school. 



Provide state input 
and assistance as 
requested by district. 



\ ■ 



Provide district inpuf 
and assistance as 
requested by school: 



Provide state input 
and assistance as 
requested by district. 
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AMtmMffit Stops 



Work Phases 



Duties and Rssponslbilltits 



SCHOOL 



DIttrict 



Stals 



7. DETERMINATION OF 
DATA SYNTHESIS AND 
PRESENTATION 
PROCEDURES 



Determiniltion of how 
the information will 
be, put together 
{synthesized) and 
presented (displayed 
and reported). 



8. COLLECTION OF DATA 



9. ANALYSIS OF DATA 



tmplementation of 
procedures and 
schedule for data 
collection. 

Implementation of data 
analysis and inter- 
pretation procedures. 
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Assume responsibility 
for determining data 
.synthesis and presen- 
tation procedures. 



Obtain input or consult 
with district, state 
and other appropriate 
individuals or groups. 

•Assume responsibility 
for school leadership 
and coordination of , 
data collection effort. 

Obtain input or consult 
with district, state 
and other appropriate 
individuals or groups. 

Compile, analyze and 
interpret data. 

Obtain input or consult 
with distrrct, state 
and other aqpropridte 
individuals ongroups. 

Distribute assessment 
report(s) to intended 
audiences. 



Provide district input 
and assistance as 
requested by school. 



Proved district input 
and assistance as 
requested by school. 



, Provide district input 
and assistance as 
requested by school 



Provide district input 
and assistance as 
requested by school. 



/ 



/ 



Provide state input 
and assistance as 
requested by district. 

Provide state input 
and assistance as 
requested by district. 

Provide state input 
and assistance as 
requested by district. 



Provide state input 
and assistance as 
requested by district. 
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APPENDIX 



APPENDIX A. RESOURCES ON ASSESSMENT 

At the State and District levels, there ape staff members who are able to-provide technical 
assistance to schools on assessment. These include staff from the Test Development and 
Administration Section and the Evaluation Section in the State* Office, and the testing 
coordinators in the District Offices. In addition, there are faculty members at the insj^utions of 
higher learning who may serve as resource persons to schools, districts, and the State Office 
in conducting ^n assessment. Schools needing State assistance on ass^sment should work 
through their District Offices. 

In addition to resource persorTnel, numerous publications on assessment are also 
available. A brief listing of some of these publications follows.,This listing can serve only as a 
general guide to the user who wishes to know more about assessment or to increase skill in 
this area. Each publication is annotated briefly to describe its major content. For ttie 
convenience of the user, a summary form is also provided at the end which relates each 
publicatfon on the listing to major elements and purposes of assessment. 

• 

Selecteff Publications on Assessment . 

A Compendfum of Assessment Techniques, Joan Knapp and Amiel Sharon, Cooperative 
Assessment of Experiental Learning (GAEL), Educational Testing Service, Princetoh, New 
Jersey. 1975. 50 pages. ' ' . - ' . ^ ^ 

This brief handbook provides an introduction to techniques that can be used to assess 
student learning "by doing"— th.e kind of learning that takes place when an individual 
participates in a variety of social, artistic, political, work, orcro^-cultural activities off the 
campus. Although the GAEL project which developed the cimipendium focused on 
higher education, the techniques described are appropriate at tj^e lower education l^vel 
as weH. • . * * 

The publication provides a relatively brief discussion of a number of assessment' 
tecliTrtflyes, with sufficient detail to allow the user to detejrnjine whether a {Particular 
lechniqueinigJit be applicable to his or her own situation. Although not a procedural 
manual showing how to develop-and administer assessment techniques, it does provide 
sufficient information and refererices for the reader who wants to know more about a 
particular technique. The techniques described include: performance tests,$imulations, 
assessment centers, essay, examinations, objective written examinations, interviews, 
' self-assessment ratinqs. and product assessment. 



A Look^it th0 MoMic of Educationai Evaluation aitd Accountability, Blaine R. Worthen. 
NWREL. 1974. 38 wges. 

Tjjis^ort, non-technical monograph is a general introduction to the subject of 
^^BlKmon, including accountability and assessment. Basic definitions and briet 
discussions of concepts such as the following are provided: measurement, assessment, 
evaluation, accountability, research, evaluation for* decision-making, formative and 
^ summative evaluation, internal and external evaluation (and possible combinations), 
goal-directed and 'goal-free evaluation, and comparative land non-comparative 
evaluation. 

In addition, experts with differing points-of-view on evaluation are quoted, arrd the 
characteristics of good evalus^on are described. 

. Copies of this monograph have been distributed widely in the Departrtient. An additional 
copy, may b6 obtained from the Evaluation Section, Office of the Supertntendenf. 

9 

About LMming Materials, M. Frances Klein, ASCD, 1701 K Street, N.W., Washington, D. C. 
1978.' 45 pages. 



This handbook provides a comprehensive guide with implications for many facets of 
decfsion-making as related to the selection of instructional materials and instructional 
Improvement | ^ ' 

Hi-lltes of this handbook are the listing of resources for evaluating instructional materials, 
the discussion of problems associated with developing and evaluating instroctional 
materials, and the materf&ls in the appendix prepared by Richard 1. Miller entitled, 
"Selecting Ndw Aids to Teaching." This material provides specific and realistic guides to 
assist schools in making better divisions about instructional units. 



Evaluating Instnictlonal Programs, Bruce Wayne Tuckman, Allyn and Bacon, Inc., 1^79 . 309 
pages. ^ " " 

This book provides all the tools necessary to evaluate school-based instructional^^ 
• programs^vt outHhes ihd« basic evaluation components— outcomes, inputs, processes, 
and design— In operational terms including instructions on.how to write objectives, how 
to select or design measuring instruments, how to record findings, and how to design 
comparisons. It also describes ^operational procedures for conducting thr^e types of 
'evaluation— formative, summative, and ex post facto— as well as how to dvoid the pitfalls 
of conducting evaluations, included are four case studies that are actual evaluation 
reports that jllustrate the various approaches covered in the book. 



Evtluator'i Handbook, Lynn Lyons Morris and Carol taylorFit2;-Gibbon, Center for the Study . 
of Evaluation, .UCLA, Sage Publications, Inc., Beverly >Hills,^ 1978. 133 pages. , 

^ This handbook is part of the Program Evaluation Kit, a set oi books intended to assist 
people who are conducting evaluations of educational programs. The introduction 

' contained in Ch^i^^r 1 calls* attention to the criticaf issues surrounding prograot 
evaluatiDn. Chapter 2, entitled ''How to Play theDole of Formative Evaluator," describes 
the diversified job of the formative eva|uator who inters into 4 helping relationship with a 
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program's staff.^hapters 3. 4., and 5 contain step-byrstep guides for organizing and 
accomplishing three types of evalua^ns: 

• A formative evaluation during program 1n$tallation'and development; 

* • A standard summative evaluation based on measurement of achievement, attitudes, and/or 
program^ impl^me^at ion; ~ ^ 

• A smatfaxperimant, Mrocedura of interest to,a user who wishes to conduct pilot tests or to 
evaluate a program aimed toward a few measureable objectives. 

How (to Design a Program Evaluation, Carol Taylor Fitz-Gibbon and uf^nn Lyons Morris, 
Cenler for t»^ Study W Evaluation. UCLA. Sage Publications. Inc.. Beverly Hills, 1979/lfe4 
pas(est 

,The objective of this book is to acquaint the user with ways in which eval Jation results can 
be made more credible: Choosing a design which prescribes when and from Whom data 
will be gathered, putting it into operation, and analyzing^and reporting the datagathered. 
The underlying premise of the book is that attention to design is Importal^ 

Cfftpter 1 discusses the distinctions between formative and summative evaluations, with 
focus on the special problem areas of compenrsatory and special education programs. 
Chapter Z discusses design elements in program evaluation and anticipated problems 
such as control groups, ^ ' 

Chapters 3 through 6 outline six kinds of desigfts. including control group designs, time 
series designs, and before-and-after designs. Chapter 7 discusses analysis of variances, 
and Chapters provides practical suggestions on how to randomize. 

How to Measure Achievement, Lynn Lyons Morris arwhCarol Taylor Fitz-Gibbon, Center for 
the Study of Evaluation. UCLA. Sage Publications. Jnc, 1978. 159 pages. 

The purpose of this book is to help the user evafuSle how well a program has met 
achievement qbjectives. It provides suggestions, procedures, and rules ot thumb for 
performing evaluation tasks rfelated to measuring achievement for program evaluation 
and introduces. some of the theory underiying the procedures for developing and 
selecting achievement-tests and interpreting their results.. 

Each of the book's six chapters provides practical advice on one^ea of measurement of 
achievement. The list of opening questions in Chapter 1 helps tfie user to decide what to 
measure and how much time and effort to invest in measuring bievement. The chapter, 
as well as the whole t)Ook. deals with achi^ement tests. 

The topic of Chapters 2 and 3 is selecting and obtaining published tests. Chapter 2^ 
describes the types of achievement test data that might already be available-in schools 
and discusses ways in which they might be useful in an e\^luation. Also provided is a list 
of sources of published tests that may be purchased ojr borrowed. 

To assist^ ki estimating test appropriateness. Chapter 3 pr;esents a table.and procedures 
for comparing a test with a program's rnost important objectives. 

Should the user wish to construct a test, ^apter 4 provides a guide toiesources for 
custom-designing a test. It references How To guides on test constmdPon^and item 
writing. In addition, it contains an annotated list of test item and objective^ banks in 
various subject-matter areas, and a list of testing services on X^pX designing'and j^coring. 
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Chaptm«:^'^d 6 deal with technical quality and use of tests. Chapter 5 discusses 
reliability andStali^[|ty>/ssues in achievement testing. Chapter 6 contains a short 
discussion of test interpretation and score reporting. 

Howlo MMSurt AttltudM, Marlene E. Henersod, Lynn Lyons Morris, and Carol Taylor Fitz- 
Gibbon, Centet for the study of Evaluation, UCLA, Sage PubHcations, Inc., Beverfy Hills, 
19^3. 179 pages. - 

This bool( is intended to help users/develofT^ic sloUs in designing and using 
instruments for the measurement of affective objectives or attitudes. Whenever possible, 
the boolc recommends procedures, rules of thumb, and practical strategies for^ 
performing both formative and summative evaluation tasl(s related to the asse^smeixt of 
people's attitudes. Included are si^ggestiohs for summarizing, analyzing, and displaying 
data and a listing of names and addresses of publishers of attitude measures. 

« ^ How to Measure Program Implementation, Lynn Lyons Morris, Carol Taylor Fitz-Gibbon, 
Center for the Study of Evaluation, UCLA, Sage PuBlications, Inc., 1978.^ 140 pages. 

The overall intent of this bool( is to user develop sidlls in describing program 

^ implementation and in designing ancTulfhg appropriate measurement instruments to 
bacl( up the description of a program's! implementation. ' 

' Three majlir purposes are reflected in the organization of the book: 

1. To list program features and activities Attended to and described in a progam 
implem^tatlon report. 

2. To help decide how muchr effort to spend on describing program implementation. 

3. To guide the designing of instruments to produce adequate bacl(up data. 

Chapter 1 discusses the reasons for examining a program's implementation. Chapter 2 
prdvides an outline for the implementation section of an^e^luation report. With this 
, outline as a guide, thr user can produce a detailed description of the programi)ased on 
the answers to the probes accompanying each heading. 

Chapters 3 through 7 corpprise the "How to Measure" section of the tool<. Chapters 3, 4, 
5, and 6 describe methods of measurement — examination of records, observations, 
interviews, questionnaires. Chapter 7 discusses validity and reliability, factors reflecting 
the quality of the melisures. 

How to Preeent an Evaluation ReporC Lynn Lyon^ Morris and Caroj Taylor Fitz-Gibbon, 
. Center for the Study of Evaluation, UCLA, Sage PuWfcations, Inc., Beverly Hills 1978. 80 
pages. 

The purpose bf this book is to provide guidelines for effectively conveying evaluation 
" information to various audiences. The book contains prescriptions andttelp^u) hints for 
formal ancHnformal reporting, either written or oraL 

How to Preeent en Evaluation Report has three sections. Chapter 1 is devoted to 
organizing Ideas! Chapter 2 presents a standard outline for an evaluation report. This 
outline is intended to be exhaustive of the types of information that can be conveyed to 



various audiences. This outline can be followed by the user to the letter, or the user can 
simply use it-.to become familiar With the -set of topics that shotild be discussed in an 
evaluation report. . 

Chapter 3 provides assistance in. organizing reporting methods for maximum impact. 
Consisting of a list of topics. Chapter <3 is a compendium of communication pointers. It 
includes advice on choosing what information to present to various audiences and 
pointers on good writing and effective verbal presentations. , 



^feTTdescribes data presentation methods, including tables, graphs and charts. 

Re^yTng heavily on examples, it contains prototypes of graphs and charts for displaying 
attitude, achievement, and program implementation data. To assist with oral 
presentations, the chapter presents a step-by-step procedure forpreparing audiences to 
read and interpret graphs. 

Middle School/Junior High School Evaluative Criteria, A Guide for School Improvement, 

Donald C. ManLove, Lyie Mowrey, National Study of School Evaluation, 2201 Wilson 
Boulevard, Arlington, Virginia, 1979. (Also available for the elementary level). 

This manual pirovides guidelines for conducting self-evaluation by individual 
middle/junior high schools and evaluation by a visiting committee. The manual is 
comprised of 12 sections. The, section on "School and Community" together with the 
section on "Philosophy and Goals" and the seqtion on "Major Educational Priorities" form 
the foundation for the school self-study process and undergirds the entire evaluation. 
The next two sections "Design of Curriculum" and "Learning Areas" are closely related 
since all include aspects of the formal education program. Section V, on design, focuses 
on the organization of the fcurriculum, and Section VI is intended for use in all areas of 
instruction the school identifies. Section. VII covers the individual faculty data and' 
SectionVIII gives attention to the administration, instructional staff, and auxiliary staff. 
Section IX, "Student Personnel Services," includes such services to students as 
guidance, health, special education, food, and transportation. Theliaat section deals with 
the school plant and facilities. 

Worksheets are provided for each section. • ^ 

Planning a Program Evaluation, An Educator's Handbook, John J. Bowers, Research for 
Better Schools, Inc., 1700 Market Street, Philadelphia, Pennsylvania, 1978. 

The handbook is intended to h^lpnschools plan their curriculum program evaluations. Its 
focus is on evaluation plannifjg, rather than detai4^f executing the plan. 

The planning process consists of five steps. The first step is to clarify the questions and 
concerns that led to the decision to plan the pPogrfim evaluation. The second step is to 
summarize basic facts about <he program to be evaluated. The third step begins by 
identifying program elements which are considered to be relevant to the concerns and 
questions listed in step one and classifying these program ^ments into categories 
reflecting student outcomes, curriculum content, content ^sequence, instructional 
lipproaeth-and, prograffTsupport. The fourth step consists of determining the relative 
Importance^ 3ach wevan(prograrn element and selectingthe most important ones for 
further aittention..The^h sfep^sopSists of specifying data collection requirements for 
each retaii^ifelselementartJ^ developing judgement criteria for interpreting the data to be 
collected. 

Work forms are provided for each ot these steps. 
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TiM Planhing Book for Noitlt /^^setsmont, Kariree Watson, Iowa State University Research 
Foundation, Inc., 1978. 44p^es. 

. ^ This publication on needs assessment was developed for the state of Iowa for 
lidministrators and tochers. The focus is the instructional program and the 
implementation of the needarassessment goals in that j!)rogram. The material is organized 
into three sections: Goals (Part I); Status and Analysis (Part II); and Implementation and 
Evaluation (Part III). 

Probtems and Potentials of^Applied Performance Testing, James R. Sanders and Thomas P. 
Sachese, Clearinghouse for Applied Performance. Testing NWREL, December 1975, 159 
pages. * ^ 

This work reports on the National CJonference on the Future of Applied Performance 
Testing. It includes addresses and report? of groupdiscussions. Of especial value are the ' 
guidelines for the evaluation of applied performance test materials and procedures 
contained in the Appendix, * ^ 

Program Evaluaticm Skills for Busy Administrators, Thomas R. Owens and Warren D. Evans. 
NWREL, 1977, •SS pageS, ^ 

° This manual gives a conpj^ introduction to program evaluation for educational 
administrators. While the focus is on the busy school administrator, the manual is useful 
to educators at all levels of resppnsibility, especially individuals and groups preparing for 
systemafib assessmen|,and, evaluation. ^ 

Included in the manual are non-technical discussions on aspects of evaluation, 
rationales, formats, and rating forms for planning and executing assessments and 
prog rap evaluatidns. Majoi- topics consjst of purposes of evaluation, describing a 
prog rani£»r activity establishing evaluation guidelines, preparing an 
' evaluanm^lan, imnemen^ng the evaluation, and reporting findings. 
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ies o^^rnanua^ve been distributed widely in the Department An additional copy 
irt^beobt^^fromthe Evaluation Section, Office of the Superintendent. 
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Publications 



'A COMPENDIUM OF ASSESSMENT TECHNIQUES. Joan 
Knapp and Amiel Sharon, Cooperative Assessment of 
Bcperiential Learning (CAEL). Educational Testing Service, 
Princdton, New Jersey, 1975. ' 

A LOOK AT THE MOSAIC OF EDUCATIONAL 
EVALUATION AND ACCOUNTABILITY. Blaine R. 
Worthen, NWREL, 1974. 

ABOUT LEARNING MATERIALS. M. Frances Klein. ASCD. 
1701 K Street, N.W.. Washington. D.C.. 1978. 



EVALUATING INSTRUCTIONAL" PROGRAMS, Bruce 
Wayne Tuckman. Allyn and Bacon. Inc.. 3979. y 

EVALUATOR'S HANC|BOOK. Lynn Lyons -Worrisind Carol 
Taylor Fitr-Gibbon. Cienter for the Study of Evaluation. 
UCLA. Sage Publications. Inc.. Beverly Hills; 1978. 



HOW TO MEASURE ACHIEVEMENT. Lynn Lyons Morris 
dhd Carol Taylor FKz-Gibbon. Center for the Study of 
Evaluation. UCLA. Sage Publications. Inc.. 1978. 

HOW JO MEASURE ATTITUDES, Mariene E. Henerson. 
Lynn Lyons Morris, and Carol Taylor Fitz-Glbbon. Center 
for the Stvidy of Evaluation. UCLA. Sage Publications. Inc.. 
Beverly Hitt^. 1978. 

HOW TO MEASURE PROGRAM IMPLEMENTATION. Lynn 
Lyons MoUn and Carol Taylor Fitz-QIbbon. Center foi^the 
^udy of Evaluation, Sage Publlcatlqns, Inc., 1978. 
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HOW TO PRESENT AN EVALUATION REPORT, Lynn 
Lyons Morris and Carol Taylor Fitz-GMbbon, Center for the 
Study of Evaluation. Sage Publications, Inc., Beverly Hills. 
1978. 



MIDDLE SCHOOL/JUNIOR HIGH SCHOOL EVALUATIVE 
CRITERIA. A GUIDE FOR SCHOOL IMPROVEMENT. 
Doruild C. ManLove. et aL National Study of School 
EvaluatiOQ. Virginia. 1979. (also for Elementary and High 
School) 



PLANNING A PROGRAM ' EVALUATION. AN 
EDUCATOR'S HANDBOOK. John Jf Bowers. Research for 
Better Schools. Inc.. 1700 Market Street. Phladelphia, 
Pennsylvania. 1978. 

THE PLANNfh^ BOOK FOR NEEDS ASSESSMENT. 
Karilee Watsdn, Iowa State University Research 
Foundation, Inc., 1978. 



PROBLEMS AND POTENTIALS FOR APPLIED 
•PERFORMANCE TESTING, Clearinghouse for Applied 
Performance Testing, NWREL, December 1975. 

PROGRAM EVALUATION SKILLS FOR BUSY 
ADMINISTRATORS, Thorpaa R. Owens and Wprren D. 
Evans, NWREL, 1977. 
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